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Abstract — In this article we present a statistical version of the 
Candes-Tao restricted isometry property (SRIP for short) which 
holds in general for any incoherent dictionary which is a disjoint 
union of orthonormal bases. In addition, under appropriate 
normalization, the eigenvalues of the associated Gram matrix 
fluctuate around A = 1 according to the Wigner semicircle 
distribution. The result is then applied to various dictionaries that 
arise naturally in the setting of finite harmonic analysis, giving, 
in particular, a better understanding on a remark of Applebaum- 
Howard-Searle-Calderbank concerning RIP for the Heisenberg 
dictionary of chirp like functions. 

Index Terms — Incoherent dictionaries. Statistical RIP, Wigner 
semicircle distribution, deterministic examples, Heisenberg- Weil 
representation. 

I. Introduction 

Digital signals, or simply signals, can be thought of as 
complex valued functions on the finite field Fp, where 
p is a prime number. The space of signals H — C (Fp) is a 
Hilbert space of dimension p, with the inner product given by 
the standard formula 

if, 9)^ E f{t)W)- 

teFp 

A dictionary D is simply a set of vectors (also called atoms) 
in H. The number of vectors in J) can exceed the dimension 
of the Hilbert space H, in fact, the most interesting situation is 
when \D \ ^ p = dimTi. In this set-up we define a resolution 
of the Hilbert space H via D, which is the morphism of vector 
spaces 

given by 9 (/) = E^es / (^) for every / e C (D). A 
more concrete way to think of the morphism 8 is as a p x 
matrix with the columns being the atoms in D. 

In the last two decades [11], and in particular in recent 
years [3], [4], [5], [6], [7], [8], resolutions of Hilbert spaces 
became an important tool in signal processing, in particular in 
the emerging theories of sparsity and compressive sensing. 

II. The restricted isometry property 

A useful property of a resolution is the restricted isometry 
property (RIP for short) defined by Candes-Tao in [7]. Fix a 
natural number n e N and a pair of positive real numbers 
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Definition II-. 1: A dictionary X) satisfies the 
restricted isotnetry property with coefficients {6i,62,n) 
if for every subset S C D such that jS"! < 71 we have 

(1 - <52) 11/11 < lie (/)||<(i + <5i) 11/11, 

for every function / e C (D) which is supported on the set 
S. 

Equivalently, RIP can be formulated in terms of the spectral 
radius of the corresponding Gram operator Let G (S) denote 
the composition 85 o Qg with Qs denoting the restriction of 
Q to the subspace Cs (D) C C (2)) of functions supported 
on the set S. The dictionary D satisfies {6i,S2,n)-RlP if for 
every subset S C D such that 15*1 < n we have 

62 < \\G{S)-Ids\\<6i, 

where Ids is the identity operator on Cs (S). 

It is known [2], [8] that the RIP holds for random dictionar- 
ies. However, one would like to address the following problem 
[1], [10], [9], [20], [21], [22], [23], [25], [24], [26], [27]: 

Problem II-. 2: Find deterministic construction of a dictio- 
nary £> with |J)| p which satisfies RIP with coefficients in 
the critical regime 

<5i, <52 ^ 1 and n = a- p, (II--1) 

for some constant < a < 1. 

III. Incoherent dictionaries 

Fix a positive real number /i e M>o. The following notion 
was introduced in [9], [12] and was used to study similar 
problems in [26], [27]: 

Definition III-. 3: A dictionary £) is called incoherent with 
coherence coefficient /i (also called /i-coherent) if for every 
pair of distinct atoms G D 

1(9^,0)1 

In this article we will explore a general relation between RIP 
and incoherence. Our motivation comes from three examples 
of incoherent dictionaries which arise naturally in the setting 
of finite harmonic analysis: 

« The first example [18], [19], referred to as the Heisen- 
berg dictionary Dh, is constructed using the Heisenberg 
representation of the finite Heisenberg group H (Fp). The 
Heisenberg dictionary is of size approximately p^ and its 
coherence coefficient is /i = 1. 
• The second example [15], [16], [17], which is referred 
to as the oscillator dictionary So, is constructed using 
the Weil representation of the finite symplectic group 
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SL2 (Fp). The oscillator dictionary is of size approxi- 
mately and its coherence coefficient is /i = 4. 
• The third example [15], [16], [17], referred to as the 
extended oscillator dictionary ^eo^ is constructed using 
the Heisenberg-Weil representation [28], [13] of the finite 
Jacobi group, i.e., the semi-direct product J (Fp) = 
SL2 (Fp) IX H (Fp). The extended oscillator dictionary 
is of size approximately and its coherence coefficient 
is ^ = 4. 

The three examples of dictionaries we just described con- 
stitute reasonable candidates for solving Problem 111-. 21 They 
are large in the sense that |!D| ^ p, and empirical evidences 
suggest (see [1] for the case of TIh) that they might satisfy RIP 
with coefficients in the critical regime dll-.ll ). We summarize 
this as follows: 

Problem III-.4: Do the dictionaries So and Tieo sat- 
isfy the RIP with coefficients ^1,^2 ^ 1 and n — a ■ p, for 
some < a < 1? 

IV. Main results 

In this article we formulate a relaxed statistical version of 
RIP, called statistical isometry property (SRIP for short) which 
holds for any incoherent dictionary !D which is, in addition, a 
disjoint union of orthonormal bases: 

S) = [] B„ (IV-.2) 

where — is an orthonormal basis of 7i, for 

every x e X. 

A. The statistical restricted isometry property 

Let X) be an incoherent dictionary of the form ( IIV-.2I I. 
Roughly, the statement is that for 5 C S), |5| = n with 
n = p^^^, for < e < 1, chosen uniformly at random, the 
operator norm ||G (S) — Ids\\ is small with high probability. 
Precisely, we have 

Theorem IV-A.l (SRIP property [14]): For every fc e N, 
there exists a constant C (k) such that the probability 

Pr(||G(5)-/ds|| >p-'^/2) < C(fc)pi--''=/2_ (IV-A.l) 
The above theorem, in particular, implies that probability 

Pr (||G (5) - /dsll > p"''/^) ^ as p cx) faster thenp"' 

for any I e N. 

B. The statistics of the eigenvalues 

A natural thing to know is how the eigenvalues of the Gram 
operator G (S) fluctuate around 1. In this regard, we study the 
spectral statistics of the normahzed error term 

I^{S)^ip/nf' {G{S)~Ids). 

Let /9e(s) — "-^^ '^Ai denote the spectral distribution 
of E (5) where A,;, i — l,..,n, are the real eigenvalues of 
the Hermitian operator E (5). The following theorem asserts 
that converges in probability as p ^ 00 to the Wigner 
semicircle distribution pg(j (x) = {2tt) ^ y^A — ■ l[2,-2] i^) 
where 1[2 _2] is the characteristic function of the interval 
[-2,2]. 



Theorem IV-B.l (Semicircle distribution [14]): We have 

lim Pe = Psc- (IV-B.l) 
Remark IV-B.2: A limit of the form dlV-B.lb is familiar in 
random matrix theory as the asymptotic of the spectral distri- 
bution of Wigner matrices. Interestingly, the same asymptotic 
distribution appears in our situation, albeit, the probability 
spaces are of a different nature (our probability spaces are, 
in particular, much smaller). 

In particular. Theorems II V- A. II IIV-B.II can be applied to 
the three examples Dh, 2)o and T)eo^ which are all of the 
appropriate form ( |IV-.2t . Finally, our result gives new infor- 
mation on a remark of Applebaum-Howard-Searle-Calderbank 

[I] concerning RIP of the Heisenberg dictionary. 

Remark IV-B.3: For practical applications, it might be im- 
portant to compute explicitly the constants C (fc) which ap- 
pears in (lIV-A.lb . This constant depends on the incoherence 
coefficient /i, therefore, for a fixed p, having fi as small as 
possible is preferable. 
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